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Objectives:  Our  goal  was  to  explore  the  utility  of  the  CWS  index  of  performance,  and  to 
apply  that  index  to  team  performance. 

Key  Findings;  We  found  that  CWS  can  do  a  reasonable  job  of  capturing  expertise  in 
arithmetic  compared  to  indices  that  incorporate  correct  answers.  We  also  found  (in 
conjunction  with  Rick  Thomas  and  Alex  Kirlik)  similar  results  for  a  performance 
domain,  putting  a  golf  ball.  In  addition,  we  initiated  the  development  of  designs  that 
allow  the  extraction  of  individual  performance  from  team  scores. 

We  used  the  CTEAM  simulation  to  study  the  development  of  expertise  of  teams 
of  simulated  air  traffic  controllers.  CWS  served  as  the  primary  index  of  performance, 
although  traditional  measures  were  examined  as  well.  As  a  performance  measure,  CWS 
(based  on  time  through  sector)  was  observed  to  be  more  sensitive  to  improvement  over 
practice  than  operational  errors.  Experts  make  too  few  errors  to  provide  differential 
accuracy  information,  while  CWS  attends  to  aspects  of  performance  that  can  always  be 
observed,  whether  errors  are  made  or  not. 

At  the  individual  level,  initial  (untrained)  skill  superiority  was  maintained  over 
trials.  Moreover,  training  yielded  skill  superiority  that  was  not  overcome  with  practice. 
Thus,  with  individuals,  rank  orders  of  performance  were  maintained  whether  initial 
superiority  was  produced  by  individual  differences  or  by  training. 

A  similar  picture  emerged  for  team  training.  That  is,  initially  superior  teams 
maintained  their  advantage  over  trials.  Although,  inferior  teams  generally  improved  with 
practice,  they  did  not  catch  up  to  the  superior  teams.  As  with  individuals,  final  rankings 
were  highly  correlated  with  initial  rankings. 

Personnel  supported;  The  Pis  (Weiss  and  Shanteau)  received  support  for  the  summer 
months.  At  CSULA,  Kristin  Brennan  was  supported  and  she  received  an  M.A.  degree  in 
2006.  Lydia  Jennings  also  received  some  support,  and  she  is  expected  to  receive  an  M.A. 
degree  in  2007.  At  KSU.  John  Raacke  and  Brian  Friel  were  supported  and  they  received 
Ph.D.  degrees  in  2004  and  5,  respectively.  Christopher  Barlett,  Christopher  Vowels,  and 
Margo  Voller  received  support  during  their  pursuit  of  Ph.  D.  degrees.  Several 
undergraduates  were  supported  as  well. 
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